That is the intellectual sense. But the emotional sense is indeed, "I have no wish to know him." The speaker knows that it is not true, but he does not, all the same, say it simply to deceive; he says it because it is what he feels, and that is sufficient to bridge the gulf between them, that is to say to make him happy.